initial port for nixl #100
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
hsubramony
requested review from
kzawora-intel,
xuechendi,
mswiniarsk and
adobrzyn
as code owners
|
the latest commit 9322571 works with vllm commit 17373dcd93ca60554d72cef4e159e70abbfd15af |
|
updated to latest vllm-gaudi + latest vllm |
xuechendi
reviewed
Sep 3, 2025
xuechendi
reviewed
Sep 3, 2025
tests/v1/kv_connector/nixl_integration/run_tpu_disagg_accuracy_test.sh
Outdated
Show resolved
Hide resolved
xuechendi
reviewed
Sep 3, 2025
hsubramony
force-pushed
the
port_nixl
branch
from
d5b73f8 to
7e56265
Compare
yeonsily
reviewed
Sep 3, 2025
xuechendi
reviewed
Sep 3, 2025
|
@hsubramony , please fix pre-commit formatting issues |
|
@hsubramony , please fix for failed CI and pre_commit |
xuechendi
reviewed
Sep 5, 2025
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
spec decode Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Chendi.Xue <[email protected]>
Signed-off-by: Chendi.Xue <[email protected]>
xuechendi
reviewed
Sep 8, 2025
xuechendi
reviewed
Sep 8, 2025
xuechendi
reviewed
Sep 8, 2025
xuechendi
reviewed
Sep 8, 2025
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
xuechendi
approved these changes
Sep 8, 2025
Signed-off-by: Harish Subramony <[email protected]>
kzawora-intel
approved these changes
Sep 11, 2025
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
xuechendi
reviewed
Sep 11, 2025
Signed-off-by: Harish Subramony <[email protected]>
hsubramony
force-pushed
the
port_nixl
branch
from
7308d8d to
12edae1
Compare
|
Did local test with sharegpt perf evaluation on both G2 and G3 [Regular path], see no perf regression |
hsubramony
force-pushed
the
port_nixl
branch
from
f7f9419 to
12edae1
Compare
Signed-off-by: Harish Subramony <[email protected]>
xuechendi
reviewed
Sep 11, 2025
xuechendi
reviewed
Sep 11, 2025
kfojcik-intel
pushed a commit
to kfojcik-intel/vllm-gaudi
that referenced
this pull request
Sep 12, 2025
port nixl --------- Signed-off-by: Harish Subramony <[email protected]> Signed-off-by: Chendi.Xue <[email protected]> Co-authored-by: Chendi.Xue <[email protected]> Signed-off-by: Katarzyna Fojcik <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
port nixl